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[57] ABSTRACT 

A real time equalizer-enhancer apparatus, comprises: a plu- 
rality of analog multipliers (33) having one input (X) 
connected to the sampled input signal, and the other (Y) 
input connected to the output of an operational amplifier 
(34); at least one operational amplifier provided with feed- 
back resistor (35), the output of which is connected to the 
input of one or more of the said plurality of analog 
multipliers, and the input of which is connected to one or 
more summing resistor, and a plurality of summing resistor; 
(36) connected between the output of each of the said analog 
multipliers (33) and the input of the operational amplifier 
(34); means being provided to combine the outputs of the 
said plurality of analog multipliers according to a predeter- 
mined combination rule, means also being provided to 
subtract said combination of multipliers outputs from pre- 
scribed constant bias values, and to feed the results back into 
the inputs of the analog multipliers (33). 

10 Claims, 8 Drawing Sheets 
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SIGNAL PROCESSING DEVICE 

FIELD OF THE INVENTION 

The present invention relates generally to signal 
processing, and more specifically to apparatus for carrying 
out the equalization and enhancement of audio and video 
signals via a dynamic range reduction which is performed by 
a non-causal feedback automatic gain control (AGC) algo- 
rithm. 

BACKGROUND OF THE INVENTION 

The dynamic range (DR) of a signal is determined by the 
ratio between the maximum value that the signal may 
possess, and the minimum significant difference between 
any pair of samples within the signal. Hence, the signal DR 
defines how many distinct levels of intensity a subsequent 
user of the signal must have, in order to fully exploit the 
information conveyed by the signal. The DR is a major 
factor in the cost of processors, data storages, and data 
communication links. The DR of media and displays such as 
loudspeakers, electronic picture-tubes and picture-paper is 
physically limited. Typical limitation of visual media is 256 
distinct levels, while some state of the art sensors have 
output signal DR that approach 10 5 . Many details of mean- 
ingful information of such high DR signals will be lost when 
displayed on a picture-tube or on paper. 

The DR of light intensities in natural views and scenarios 
may exceed 10 10 . It has been known for a long time that the 
eyes of animals, as well as the human eye, are capable of 
reducing the DR of detected light signals by many orders of 
magnitudes. Some signal processing performed in biological 
sensors such as the eye, have been successfully modeled by 
a spatial, or non -causal feedback AGC algorithm, whose 
block diagram is schematically given in FIG. 1. In this 
model the input signal is multiplied by a difference of a 
constant and a non-causal average of the output signal. As a 
result, the transmission of this model to the average level of 
the input signal exhibits a logarithmic nature, according to 
curve A of FIG. 2. Due to the average logarithmic 
transmission, the average level of the output signal cannot 
exceed a prescribed constant value, despite an arbitrary 
increase in the input average level. Simultaneously, The 
transmission of the same model has the trend to enhance 
local variations in the input signal, according to curves B of 
FIG. 2. The combined result of these two different responses 
of the said AGC model is a decrease of the signal dynamic 
range which is obtained without any apparent loss of infor- 
mation. This double-role operation is termed "Equalization- 
Enhancement". 

THE PRIOR ART 

The generalized approximation of the said model consti- 
tutes the class of neighborhood transforms which actually 
cover many known signal processing techniques, such as 
convolution. Signal processing generally consists of three 
phases: preprocessing, data reduction, and recognition. At 
the preprocessing phase, the complete signal is usually 
processed by algorithms which are unaware of the content of 
the signal, and merely improve its quality. Examples are 
histogram equalization, noise reduction, peak detection, 
smoothing, thresholding, etc. 

The preprocessing phase of signal processing requires the 
handling of a huge flow of information. Many preprocessing 
algorithms operate on small neighborhoods or segments of 
the signal at a time, while others, such as histogram pro- 
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cessing and certain integral transforms, process the whole 
signal before any result can be generated. Some preprocess- 
ing systems are designed to imitate the human eye, but are 
merely approximations of what the eye can do. 

5 Some conventional image processing systems acquire 
images from an image acquisition unit, such as a camera, 
which produces each image in a raster scan format. The 
video signal is typically forwarded to a pipeline of neigh- 
borhood processors, such as convolvers, and integral pro- 

10 cessors such as histogram and fast Fourier transformers. In 
addition, the preprocessors typically generate their outputs 
in a raster scan format so that one preprocessor can direcdy 
feed into the next one. The approximate AGC algorithm in 
image processing is a special case of neighborhood trans- 
forms. A neighborhood transform is an image mapping 

15 operation where each pixel value of the output image is a 
function of the value of the corresponding pixel of the input 
image and the pixels in a local region surrounding it. 
Neighborhood transforms can use neighborhoods of arbi- 
trary size, but most are of a specific size such as a cascaded 

20 series of transforms using 3x3 neighborhoods. These 3x3 
neighborhoods involve only the eight nearest neighbors 
surrounding a given pixel to be processed. 

Another special case of neighborhood transforms are 
convolutions. Usually these are linear filters, such as High- 

25 Pass filters that enhance contours and border lines within the 
processed pictures, or Low-Pass filters whose common task 
is to reduce noise. In general, linear convolutions are rather 
limited in performance, and are considered as heavy time 
and memory consumers. 

30 Homomorphic filters, such as described in U.S. Pat. No. 
5,247,366, have been introduced to signal processing during 
the last decade. These are non-linear processors that essen- 
tially divide every sample of the original signal by the 
corresponding sample of Low-Pass filtered version of the 

35 original signal. Homomorphic filters can achieve bounded 
amounts of dynamic range reduction, however they are 
cumbersome to implement, potentially sensitive to errors, 
and highly demanding in computation time and hardware. 
The concept of causal feedback AGC has been known and 

40 used for many years in communication and signal condi- 
tioning. There, a causal averaging is commonly utilized by 
some type of Low-Pass Filter or an Integrator, that merely 
slows down and limits the signal rate of change in time. This 
in turn, results in time -dependent AGC devices the response 

45 of which to video signals would necessarily depend on the 
direction in which the photographed scenery had been 
scanned by the camera — a very unfavorable phenomenon. 

In a non-causal signal processing system operating in real 
time, the procely higher values of surrounding output 

50 samples, of which some may have not yet been processed. 
This leads to an iterative, or recurrent process, where a 
repetitive application of a feed-forward AGC is used, in 
which the output in every repetition depends on the output 
in the preceding repetition, so that it is not an explicit 

55 function of the input only. This type of repetitive algorithm 
may eventually converge to a value nearly identical with that 
one would obtain from a feedback AGC. Unfortunately, the 
iterative process requires a great deal of processing time and 
memory, thus limiting its use in real time and increasing its 

60 cost. 

Image processing apparatus of the general type discussed 
above is described, e.g., in WO 90/01750, WO 90/01844 and 
WO 90/01845. 

65 SUMMARY OF THE INVENTION 

Therefore, what is needed in the signal processing field is 
an improved signal processor that approximates the non- 
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causal feedback AGC model for the natural process that 
takes place in biological sensors, but is not constrained by a 
time consuming iterative algorithm and does not require a 
large memory, so that the system can inexpensively operate 
in real time. 

It is an object of the present invention to provide such an 
improved signal processor. 

It is another object of the invention to provide a device 
that is not constrained by a time consuming iterative algo- 
rithm and does not require a large memory. 

It is a further object of the invention to provide a proces- 
sor that can be operated inexpensively in real time. 

Other objects of the invention will become apparent as the 
description proceeds. 

The real time equalizer-enhancer apparatus according to 
the invention comprises: 

a plurality of analog multipliers having one input con- 
nected to the sampled input signal, and the other input 
connected to the output of an operational amplifier; 
at least one operational amplifier provided with feedback 
resistor, the output of which is connected to the input of 
one or more of the said plurality of analog multipliers, 
and the input of which is connected to one or more 
summing resistor; and 
a plurality of summing resistors connected between the 
output of each of the said analog multipliers and the 
input of the operational amplifier; 
means being provided to combine the outputs of the said 
plurality of analog multipliers according to a predetermined 
combination rule, means also being provided to subtract said 
combination of multipliers outputs from prescribed constant 
bias values, and to feed the results back into the inputs of the 
analog multipliers. 

According to a preferred embodiment of the invention, 
the real time equalizer-enhancer apparatus comprises: 
a sampling switch for feeding the samples of the input 
signal into a plurality of analog delay lines, either with 
or without taps; 
a plurality of such analog delay lines, connected at one 
end to the said sampling switch, and at the other end to 
a plurality of analog multipliers; 
a plurality of analog multipliers having one input con- 
nected to the said delay lines, and the other input 
connected to the output of an operational amplifier; 
a plurality of operational amplifiers provided with feed- 
back resistor, each operational amplifier output being 
connected to at least one analog multiplier, wherein the 
input of each operational amplifier is connected to 
several analog multipliers via one or more summing 
resistors; 

a plurality of summing resistors connected between the 
output of each of the said analog multipliers and the 
input of the operational amplifiers; and 
a summing amplifier to combine the outputs of the said 
plurality of analog multipliers, to yield the output 
signal of the real time equalizer-enhancer apparatus. 
According to another preferred embodiment of the 
invention, the real time equalizer-enhancer apparatus com- 
prises: 

a plurality of analog sample-hold elements, for feeding 
the samples of the input signal in cyclic order to a 
plurality of analog multipliers; 

plurality of analog multipliers having one input connected 
to the said sample-hold elements, and the other input 
connected to the output of an operational amplifier; 
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one operational amplifier provided with feedback resistor, 
the said operational amplifier input being connected to 
each of the said plurality of analog multipliers through 
summing resistors, wherein the output of the opera- 
5 tional amplifier is connected to the input of all analog 
multipliers; 

a plurality of summing resistors connected between the 
output of each of the said analog multipliers and the 
input of the operational amplifier; 
10 a plurality of analog switches each switch being con- 
nected at the output of one of the said analog 
multipliers, to feed the output signal samples to 
memory buffer means. 
According to yet another preferred embodiment of the 
present invention, the real time equalizer-enhancer appara- 
tus comprises: 

a plurality of Analog to Digital Converters (ADCs) for 
sampling and converting the input signal into 
sequences of digital words, and feeding said words into 
a Digital Signal Processor (DSP); 

20 a DSP, comprised of a plurality of registers, a plurality of 
adders/subtractors, and a plurality of multipliers/ 
dividers. Said DSP operates non iteratively and non 
recursively, namely it computes the exact output of the 
non causal feedback AGC of the present invention as a 

25 function of the input signal only, in a single computa- 
tion cycle. 

a Digital to Analog Converter (DAC) for converting the 

output of said DSP into an analog signal. 
As will be appreciated by a skilled person, the device of 
30 the present invention can be dimensioned in many different 
ways. However, a preferred device according to the present 
invention is a device wherein the components are dimen- 
sioned such that an input of equal steps evenly spaced, each 
fed thereto, results in filter response in the shape of flat 
35 values arranged along a logarithmic curve which averages 
them, which logarithmic curve is asymptotic to a prescribed 
constant level regardless of the input signal level. Said 
output flat levels are separated by transitional zones in the 
form of doublets, each of which is composed of a negative 
40 peak that appears next to the lower side of the step and a 
positive peak appearing next to the higher side of the step. 

Also encompassed by the invention is a signal processing 
apparatus comprising: 
an analog sample and storage device for sampling and 
45 storing a sampled-data representation of an input sig- 
nal; 

an analog sample and storage device for sampling and 
storing a sampled-data representation of an output 
signal; 

50 a real time equalizer-enhancer apparatus as described 
above. 

All the above and other characteristics and advantages of 
the invention will be better understood through the follow- 
ing illustrative and non-limitative description of preferred 
55 embodiments. 

BRIEF DESCRIPTION OF THE DRAWINGS 
In the drawings: 

FIG. 1 is a block diagram of the prior art model feedback 
60 automatic gain control processor. In this model the output 
signal is a product of the input signal, and the difference of 
a prescribed constant and a non-causal average of the output 
signal; 

FIG. 2 is a qualitative description of the prior art feedback 
65 AGC model transmissions, wherein Curve A: The average 
level transmission; and Curves B: The local variations 
transmission; 
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FIG. 3 is a diagram of a signal processing apparatus to the multipliers inputs. The various weights of the aver- 

having an automatic gain control circuit that uses non-causal aging in amplifiers 34 are determined by the quotients: 

averaging in the feedback path; (value of resistor 35)/(value of resistor 36). 

FIG. 4 is a simplified version of the apparatus of FIG. 3; Each pair of multipliers define two weighted feedback 

FIG. 5 is a diagram of a signal processing apparatus 5 paths. The weights can be determined in many ways. One 

whose function is identical to that of the apparatus of FIG. useful way to prescribe a weight for a given path, is to have 

3, wherein the output of the AGC filter is computed by a it proportional to some exponent of the number of taps that 

digital processor; separate between the inputs of the two multipliers that define 

FIG. 6 is a diagram of a signal processing apparatus the corresponding feedback path. An important special case 

whose function is identical to that of the apparatus of FIG. 10 of the exponential weighting is the case where the exponent 

5, wherein the analog sample-hold elements and analog basis 1S UDlt y ( oae )- In thls case a11 the weights are equal and 

delay lines are respectively replaced by analog to digital avera S c * the common arithmetic average. The outputs 

converters and digital memory buffers/shift registers; of analog multiphers 33 are further connected to a 

FIG. 7 is a quantitative example of the response of some „ ™^ ^pHfier 37 thatperforms a linear combination of 

embodiments of the present non causal AGC invention to 15 * e rndtiphers outputs. THe output of amplifier 37 consti- 

input signal that is composed of equal steps, evenly spaced; tutes 0Ut P ut sl S nal of *PP™ 30. 

FIG. 8 is a quantitative description of the equalization- In som ^ embodiments it is possible to use simplified 

enhancement factor which is calculated from the response Portions of the present equalizer-enhancer. FIG. 4 dlustrates 

exhibited in FIG 7 a s^P*™ 4 * equalizer-enhancer apparatus 40, where the 

20 tapped delay Hoe 32 of FIG. 3 has been replaced by a set of 

DETAILED DESCRIPTION OF PREFERRED analog sample-hold elements 42. The switches 41 of the 

EMBODIMENTS sample -hold cells make their contact each one at a time in a 

Illustrated in FIG. 3 is a teal time equalizer-enhancer f5^ c «der. ««* that at each sampling instant the cell that 
apparatus 30 which is illustrative of an application of the 25 h A olds the oldest data is being updated with the newest data, 
present invention. Other applications include commercial * P°Jf' ble "ample for the sample-hold elements is 
Television, cable television, satellite television, video CLC940 manufactured by Comhnear Corp. The outputs of 
cameras, medical imaging devices, satellite imaging the sample-ho ds are connected to the mputs of a plurahty of 
devices, high-fidelity audio amplifiers, video and audio multipliers 43, in an arrangement similar to that of 
recorders, video and audio communication links and 30 FIG- 3. Using a unity averaging exponent, a single opera- 
storages, and the like. The real time equalizer^nhancer UoD4 m P hfi " **■ * hose res,st0IS 45 are M ldent,cal 
apparatus 30 is based on the feedback automatic gain control m value can be used - 

(AGC) concept that is mechanized by the use of non-causal, The ° ut put signal of the equalizer-enhancer apparatus 40 

or double-sided averaging kernels as explained below. is composed of the multipliers outputs, sampled at a cyclic 

The equalizer-enhancer 30 includes a sampling switch 31 35 ° rde [- ^ j s P crfonn f d bv the P luralit y of analo 8 

that feeds the samples of the input signal into a multi-tap JJ. that feed the signals samples to an output memory buffer 
analog delay line 32. The length of the delay line is arbitrary, 

however a sufficiently adequate minimum number of stages ^ a semi-digital embodiment according to FIG. 5, the 

is 2. The delay of each stage of the delay line depends on the outputs of the delay lines 51 are converted into digital words 

specific application to be utilized. For horizontal filtering 40 b V the P luralit Y of Analog to Digital Converters 52. Said 

only, of commercial Television Video, the stage delay should di g ital words, that represent a given neighborhood of the 

be in the order of 70 to 100 nano seconds, which approxi- inP ut signal are fed into a digital processor 53. Said digital 

mately resembles the time duration of a single pixel. For this processor is equipped with all the registers, data busses, 

type of application, an example for appropriate delay line adders/subtractors, multipliers/dividers, as well as timing 

would be a product of either series 2211 or series 2214, 45 generators and appropriate commands-wither in software 

manufactured by Data Delay Devices Inc. For vertical or in hardware, so as it is capable of computing the output 

filtering only of the same type of signals, the stage delay of a non causal feedback AGC model non iteratively, as an 

must be exactly equal to the time duration of a single explicit function of the input signal only. 

Television line which is in the order of 64 micro seconds. The execution of this function requires only the four basic 

This type of synchronous delay can be performed by Charge 50 arithmetic operations and can be performed by most of the 

Coupled Devices (CCD) type of analog delay lines, such as existing digital processors, such as the TMS-320/C30, 

CXL 5001 P or CXL 5001 M, 1H CMOS-CCD, manufac- manufactured by Texas Instruments Inc. Alternatively, the 

tured by Sony Corp., Japan. For 2-dimensional filtering of computations involved can be carried out by a Central 

video signals, the two types of delay lines should be alter- Processing Unit (CPU) of any general-purpose host 

nately connected in series. Each tap of the delay line is 55 computer, such as the IBM/PC or alike. In the semi digital 

connected to an input marked x of an analog multiplier 33. embodiment, the processor output is finally converted back 

The nominal function of each one of the multipliers 33 is into an analog signal by the Digital to Analog Converter 

z-xy, where y is the other input to the multiplier and z is the (DAC) 54 of FIG. 5. 

multiplier output. An example for an analog multiplier is In a fully digital embodiment of the present invention 

AD-834, manufactured by Analog Devices Inc. 60 according to FIG. 6, the input signal is sampled and con- 

The input marked by y of each multiplier is connected to verted into a sequence of digital words by the Analog to 

the output of an operational amplifier 34, with feedback Digital Converter (ADC) 61, said words are fed into a 

resistors 35 and input summing resistors 36. The input plurality of digital shift registers, or memory buffers, 62. The 

resistors 36 are connected to the multipliers outputs and outputs of the shift registers/memory buffers are fed into a 

perform a non-causal weighted averaging of the outputs. The 65 digital processor 63, said processor computes the output of 

task of the operational amplifiers is to subtract the averaged the non causal feedback AGC model non iteratively, as an 

output from a prescribed constant, and to feed the result back explicit function of the input samples only. 
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In order to demonstrate the performance of the present 
equalization-enhancement device in a quantitative manner, a 
synthetic unidimensional stair-case input signal have been 
processed by an exact computer model of the equalizer- 
enhancer. The input signal is Graph 71 in FIG. 7. It consists 5 
of a series of 110 samples whose intensities are arranged in 
ten equal steps of 0.1 Volts each, covering together the range 
between 0 Volts and 1 Volt, and evenly spaced along the line 
of samples. The response of the filter to this input signal is 
given in Graph 72 of FIG. 7. It consists of a series of 
horizontal flat zones, separated by a series of transitional 
zones. Each of the transitional zones is a doublet, composed 
of a negative peak followed by a positive peak. The flat 
zones are the filter responses to the corresponding horizontal 
segments of the input signal. The doublets of negative and 
positive peaks are the device responses to the corresponding 1S 
transitions that separate between the stairs of the input 
signal. 

The equalization property of the present device can be 
appreciated from the values of the horizontal segments of ^ 
the output signal. Those values are ananged on a logarithmic 
curve that can never exceed the value of 1, no matter how 
large the average level of the input signal is. This implies 
that the dynamic range compression ability of the present 
device per the average input is practically unlimited. The ^ 
enhancement property can be measured if per each step of 
the output signal a quotient is calculated, which is the ratio 
between the difference of the positive and negative peaks of 
the doublet, and the difference between the two horizontal 
levels that are adjacent to the said doublet on both sides. In 3Q 
FIG, 8, the values of these quotients, as calculated from 
Graph 72 of FIG. 7, were plotted per all the steps between 
sample 20 and sample 100. One can appreciate the fact that 
the equalization -enhancement quotient, which is the ratio 
between the device response to local changes and its 35 
response to the average, is in fact growing Linearly with the 
average of the input signal. 

Graph 72 also shows a clear evidence to the non causal 
character of the present invention. Had the stepped input 
signal been introduced to the filter along the time axis, with ^ 
the steps going either upward or downward in time, in either 
case half of each of the transitional doublets would have 
precede the corresponding step in time. Conversely, the 
response of any traditional causal feedback AGC, would 
exhibit only an overshoot following a positive input step, 45 
and only an undershoot following a negative input step. 

All the above description and examples of preferred 
embodiments have been provided for the purpose of 
illustration, and are not intended to limit the invention in any 
way. As will be appreciated by the skilled person, many 50 
different arrangements can be provided for the equalizer- 
enhancer apparatus of the invention, and many different 
parts, combinations and uses can be devised, all without 
exceeding the scope of the invention. 

I claim: 55 
1. A real time equalizer-enhancer apparatus, comprising: 
a plurality of analog multipliers having one input con- 
nected to the sampled input signal, and the other input 
connected to the output of an operational amplifier; 
at least one operational amplifier provided with feedback 60 
resistor, the output of which is connected to the input of 
one or more of the said plurality of analog multipliers, 
and the input of which is connected to one or more 
summing resistor; and 
a plurality of summing resistors connected between the 65 
output of each of the said analog multipliers and the 
input of the operational amplifier; 
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means being provided to combine the outputs of the said 
plurality of analog multipliers according to a predetermined 
combination rule, means also being provided to subtract said 
combination of multipliers outputs from prescribed constant 
bias values, and to feed the results back into the inputs of the 
analog multipliers. 

2. A real time equalizer-enhancer apparatus according to 
claim 1, comprising: 

a sampling switch for feeding the samples of the input 
signal into a plurality of analog delay lines, either with 
or without taps; 

a plurality of such analog delay lines, connected at one 
end to the said sampling switch, and at the other end to 
a plurality of analog multipliers; 

a plurality of analog multipliers having one input con- 
nected to the said delay lines, and the other input 
connected to the output of an operational amplifier; 

a plurality of operational amplifiers provided with feed- 
back resistor, each operational amplifier output being 
connected to at least one analog multiplier, wherein the 
input of each operational amplifier is connected to 
several analog multipliers via one or more summing 
resistors; 

a plurality of summing resistors connected between the 
output of each of the said analog multipliers and the 
input of the operational amplifiers; and 

a summing amplifier to combine the outputs of the said 
plurality of analog multipliers, to yield the output 
signal of the real time equalizer-enhancer apparatus. 

3. A real time equalizer-enhancer apparatus according to 
claim 1, comprising: 

a plurality of sample-hold elements, for feeding the 
samples of the input signal in cyclic order to a plurality 
of analog multipliers; 

a plurality of analog multipliers having one input con- 
nected to the said sample -hold elements, and the other 
input connected to the output of an operational ampli- 
fier; 

one operational amplifier provided with feedback resistor, 
the said operational amplifier being connected to each 
of the said plurality of analog multipliers, wherein the 
output of the operational amplifier is connected to the 
input of all analog multipliers, and the input of which 
is connected to a plurality of summing resistors; 

a plurality of summing resistors connected between the 
output of each of the said analog multipliers and the 
input of the operational amplifier; 

a plurality of analog switches each switch being con- 
nected at the output of one of the said analog 
multipliers, to feed the signal samples to memory buffer 
means. 

4. A device according to claim 1, wherein the components 
thereof are dimensioned such that an input of equal steps 
evenly spaced, each fed thereto, results in filter response in 
the shape of flat values arranged along a logarithmic curve 
which averages them, which logarithmic curve is asymptotic 
to a prescribed constant level regardless of the input signal 
level, said output flat levels being separated by transitional 
zones in the form of doublets, each of which is composed of 
a negative peak that appears next to the lower side of the step 
and a positive peak appearing next to the higher side of the 
step. 

5. A signal processing apparatus comprising: 

an analog sample and storage device for sampling and 
storing a sampled-data representation of an input sig- 
nal; 
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an analog sample and storage device for sampling and 
storing a sampled-data representation of an output 
signal; 

a real time equalizer-enhancer apparatus according to 
claim 1. 

6. Apparatus according to claim 5, wherein said sample 
and storage devices are operating in a cyclic order. 

7. Apparatus according to claim 5, wherein said sample 
and storage devices comprise analog switches. 
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8. Apparatus according to claim 5, wherein said sample 
and storage devices comprise analog memories. 

9. Apparatus according to claim 8, wherein said analog 
memories comprise analog delay lines. 

10. Apparatus according to claim 8, wherein said analog 
memories comprise Charged Coupled Devices (CCD) delay 
lines. 

***** 
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